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Abstract 

We consider unstable attractors; Milnor attractors A such that, for some neighbourhood U of 
A, almost all initial conditions leave U. Previous research strongly suggests that unstable attrac- 
tors exist and even occur robustly (i.e. for open sets of parameter values) in a system modelling 
biological phenomena, namely in globally coupled oscillators with delayed pulse interactions. 

In the first part of this paper we give a rigorous definition of unstable attractors for general 
dynamical systems. We classify unstable attractors into two types, depending on whether or 
not there is a neighbourhood of the attractor that intersects the basin in a set of positive 
measure. We give examples of both types of unstable attractor; these examples have non- 
invertible dynamics that collapse certain open sets onto stable manifolds of saddle orbits. 

In the second part we give the first rigorous demonstration of existence and robust occurrence 
of unstable attractors in a network of oscillators with delayed pulse coupling. Although such 
systems are technically hybrid systems of delay differential equations with discontinuous 'firing' 
events, we show that their dynamics reduces to a finite dimensional hybrid system system after 
a finite time and hence we can discuss Milnor attractors for this reduced finite dimensional 
system. We prove that for an open set of phase resetting functions there are saddle periodic 
orbits that are unstable attractors. 

Keywords Pulse-coupled oscillator, Heteroclinic cycle, Global coupling, Hybrid system, Delay, 

Neural network. 

PACS 05.45.-a; 87.10.+e 



1 Background 

Attractors for dynamical systems are traditionally viewed as being asymptotically stable invariant 
sets which have a neighbourhood that absorbs all sufficiently close initial conditions. As a conse- 
quence the basins of such attractors contain open sets. Whereas this concept works very well for 
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simple attractors of ordinary differential equations, for more complicated attr actors the smallest 
asymptotically stable attractor may contain much more than the asymptotic dynamics of 'typical' 
initial conditions. 

Partly in response to this problem, Milnor introduced a concept of measure attractor (now 
usually called Milnor attractor) . This is a compact invariant set whose basins of attraction has 
positive measure in phase space. Examples of riddled basins |2l E| show that, even for smooth 
invertible dynamics, one can find Milnor attractors with riddled basins; i.e. such that any open 
set that intersects the basin has positive measure in the basin of a different attractor; see [Hj for a 
recent review of riddled basins. 

In the absence of smoothness or invertibility, it is clear that more exotic attractors may appear. 
Recent work |14| I15L on globally coupled networks of oscillator with delayed pulse interactions 
[IJ [5] indicates that extreme cases of riddled basin attractors, unstable attractors, can appear, 
where there is a neighbourhood U of the attractor such that almost all points exit from U under 
the dynamics. Even more surprisingly, numerical simulations jl41 1151 116j seem to indicate that 
these attractors can appear in a robust way as long as there are sufficiently many oscillators in 
the system. The main aim of this paper is to give a rigorous explanation for the appearance and 
robustness of unstable attractors in such systems. 

This paper is organized as follows. Section[21examines the general problem of unstable attractors 
in a systematic way. We give some necessary conditions for the appearance of unstable attractors 
and some motivating examples. Subsequently, we address the relationship between networks of 
unstable attractors and robust heteroclinic cycles, and present a simple recipe of how to perturb 
a smooth flow with a robust heteroclinic cycle to a smooth semiflow with a network of unstable 
attractors. 

In Section|31we consider the system of globally pulse coupled oscillators with delayed interactions 
studied in jl4j . including a generalization of the set of possible response functions. Because the 
system combines continuous time evolution with discrete time events, it is strictly speaking a hybrid 
system 1 with delay. The main result of this section is Theorem^ which shows that the dynamics 
reduces, after a finite time, to a finite dimensional hybrid system. It gives an explicit upper bound 
on the number of remaining dimensions in the system. 

In Section 13] we prove that the system discussed in Section El exhibits unstable attractors (The- 
orem 21) and that these persist for an open set of parameter values (Theorem . The proof has 
two parts; firstly we show (by following an appropriate open set of initial conditions) that a certain 
periodic orbit is a Milnor attractor; secondly we show that this orbit is a saddle. We discuss this 
mechanism as being an effect of 'dimension jump' in the system. 

Section |S1 discusses obstacles to proving the existence and robustness of unstable attractors in 
a more general setting. For convenience some of the details of the proofs have been placed in 
appendices: Appendix^ describes the system in the case that the delay is short enough that only 
one delayed pulse can influence the future dynamics of the system. Appendix El derives the return 
map on a section transverse to the unstable attracting periodic orbit. 
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2 Unstable attractors 



2.1 Milnor attractors and unstable attractors 

Consider a dynamical system defined by a semiflow i^j : M — > M on a finite dimensional manifold 
M for t > (recall that a semiflow is a family of maps such that Fg+t = Fs ° Ft whenever s > 0, 
t > 0, and such that Fq{x) = x). In what follows we will consider continuous (t G M^) or discrete 
{t € Z^) dynamics. 

Our examples arise from cases where Ft is not invertible for all f > 0: one cannot extend 
the semiflow to a flow. For convenience we will assume that M is compact and let denote 
Lebesgue/Riemann measure on M. Recall that the w-limit set of x is defined by 

u^{x) = fl {F,{x) : s>t}. (1) 

A Milnor attractor for Ft is a compact invariant subset A C M such that (i) the basin of attraction 

B{A) = {x£M : Lo{x) C A} (2) 

has positive measure in M, i.e. i{B{A)) > 0, and (ii) any compact invariant proper subset of A has 
a basin with strictly smaller measure JTP . It is a minimal Milnor attractor if any compact invariant 
proper subset of A has a basin with zero measure. All explicit examples of Milnor attractors given 
in this paper are fixed points or periodic orbits and thus they are minimal Milnor attractors because 
they do not contain any compact invariant proper subset. However, we will not explicitly discuss 
minimality in these cases. 

Definition 1 (Lingering set) Given any subset U C M we define the lingering subset of U to be 

A{U) = {xeU : Ft{x) G U for all t > 0}. (3) 



The lingering set is a (forward) invariant set consisting of points in U which do not leave U in the 
future; note that if A is an invariant set within U then A{U) is non-empty as it contains A. 

Definition 2 (Unstable Attractor) We say a Milnor attractor A is an unstable attractor if 
there is a neighbourhood U of A with 

£{Am = 0. (4) 

Requirement @ means that almost all trajectories in a neighbourhood of the attractor must leave 
this neighbourhood. We distinguish between two classes of unstable attractors. 

Definition 3 (Unstable Attractor With a Positive (Measure) Local Basin) An unstable at- 
tractor A is an unstable attractor with positive measure local basin^ if 

iiBiA) nU)>0 (5) 

for all neighbourhoods U of A. 

^For convenience of notation we refer to positive local basin (resp. zero local basin) for Def. |21 (resp. Def. IIJ. 
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Definition 4 (Unstable Attractor With a Zero (Measure) Local Basin) An unstable attrac- 
tor A is an unstable attractor with zero measure local basin if there is a neighbourhood U of A 
with 

i{B{A) nu) = o. (6) 

For an unstable attractor with positive local basin, Q) means that almost all trajectories starting 
in a sufficiently small neighborhood U will first leave U. A positive measure will eventually return 
and be asymptotic to A (contrasting with with [HlEIl where there is a positive measure that remains 
in U and is asymptotic to A). 

For an unstable attractor A with zero local basin almost all initial conditions in a sufficiently 
small neighbourhood U oi A will leave U and never limit to A."^ 

Clearly, linearly stable fixed points or periodic orbit attractors for a smooth invertible sys- 
tem cannot be unstable attractors; in such cases one can construct a neighbourhood that by the 
Hartman-Grobman Theorem is contained within the basin of attraction. If A is asymptotically 
stable then trivially it cannot be an unstable attractor. A more general observation is the following 
proposition characterizing a class of attractors that cannot be unstable with zero local basin. 

Proposition 1 Suppose that A is a Milnor attractor whose basin B{A) contains an open set, and 
suppose that Ft is almost everywhere a local homeomorphism. Then A cannot be an unstable 
attractor with zero local basin. 

Proof: Consider a point y in the interior of the basin of A such that Ft is a local homeomorphism 
in a neighbourhood of y, and choose an open neighbourhood U of A. There is a finite time T after 
which Fxiy) € U. Pick a small neighbourhood V of Fj'{y) in U; continuity of Ft means that there 
is a neighbourhood W oi y within the basin of attraction such that FtIW) C V . Continuity of 
the local inverse means that Ft{W) is also a neighbourhood of Fxiy). However all points in W 
are in the basin of A and so Ft{W) is an open set in the basin of A that is within U. Hence 
£{B{A) n [/) > for any U that is a neighbourhood of A. □ 

In particular, this proposition ensures that continuous invertible flows with continuous inverse 
(homeomorphisms) do not exhibit unstable attractors with zero local basin. We have so far been 
unable to determine whether the assumptions of Proposition ^ exclude the possibility that A is an 
unstable attractor with positive measure local basin, though clearly under additional assumptions 
(such as linear stability of A) we can exclude this case. 

As we will see below, unstable attractors occur robustly for certain classes of noninvertible 
dynamical systems. Suppose X is a space of dynamical systems under some suitable topology, such 
that one can obtain an unstable attractor for some / € A". If there are unstable attractors for all 
g' in a neighbourhood of / then we say the unstable attractors for / are robust; this means that 
they are stable to perturbations of the system within this X. In Section |1] we show robustness of 
unstable attractors with respect to perturbations of a pulse response function defining a class of 
pulse coupled oscillator systems. 

set B has positive measure if £{B) > 0; it has full measure (in U) if £{B nU) > and £(U \B) = 0. 
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2.2 Unstable attractors and riddled basin attractors 

There is no simple relationship between the lingering set for a given neighbourhood of an attractor 
and the basin of attraction; in particular there may be points that are in the lingering set and not 
in the basin, and vice-versa. For example, near a centre in a planar system the lingering set can be 
an open set but the basin just one point. Similarly the flow of x = 1 — cos(27rx) on the unit circle 
M/Z has a fixed point x = 0. The basin of the attractor A = is the whole of phase space, but the 
lingering sets of small open neighbourhoods of x = will not contain nearby points to the right of 
X = 0. 

Unstable attractors are a related but different phenomena to riddled basin attractors A 
Recall that an attractor A has riddled basin if B{A) is such that 

£{B{A) n u)e{B{A)^ nu)>o (7) 

for all open sets U that intersect B{A). In particular, any neighbourhood U that contains A will 
intersect B{A) in a set of positive measure; this means that a positive measure set in the basin leaves 
U. For unstable attractors almost all points in a small enough U will leave U; by the comment 
above, this does not have any direct implication for the basin of attraction of A, though it does 
imply that any 'local basin of attraction' relative to U will have zero measure. Examples of riddled 
basin attractors so far all possess irregular or chaotic dynamics to provide attraction local to some 
points and repulsion local to others. By contrast the dynamics observed on unstable attractors can 
be very simple, even equilibrium. 



2.3 Simple examples of unstable attractors 



To illustrate the possible types of unstable attractors we consider the dynamical systems defined 
by the piecewise continuous mapping / : [0, 1] i— > [0, 1] according to 
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if < X < i 

if i < X < i 

if J < X < I 
if I < X < 1 



(8) 



and g : [0, 1] — > [0, 1] where ^(x) = /(x) except on ^ < x < | in which case g{x) = 3(x — |). These 
two maps are illustrated in Figure ^ One can verify that the only invariant sets for / and g are 



the two fixed points x = and x 
of attraction are respectively 



2- 



These are both minimal Milnor attractors; for / their basins 



Bm) = [0: 



u 



'1 2> 
^2' 3^ 



whereas for g they are 



s({o}) = [o,i), B{a}) 



1-2' 



(9) 



(10) 



In both cases the disjoint union of the two basins is the interval [0, 1]. On the other hand, any 
open set U C |) that contains ^ has lingering set A{U) that is just the point {^}. Hence in 
both cases this point is an unstable attractor. Considering the definitions © and © above, we 
see that the attractor A = {^} is an unstable attractor with zero local basin for / and an unstable 
attractor with positive local basin for g. 
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Figure 1: Dynamical systems defined by piecewise smooth maps / and g exhibit an unstable 
attractor A = ^ with (a) zero and (b) positive local basin. 

2.4 Networks of unstable attractors 

As noted in , unstable attractors can form networks such that a positive measure of sufficiently 
small perturbations from the unstable attractor Ai are in the basin of attraction of some other 
unstable attractor Aj. We show that this is analogous to robust heteroclinic networks. 

Definition 5 A set of unstable attractors Ai, i G {1, • • • ,n} forms a network given by the directed 
graph with vertices A^. There are directed edges from Ai to Aj if and only if for any neighbourhood 
Ui of Ai we have 

£{B{Aj) n Ui) > 0. (11) 

If in addition 

Ui = \jB{Ak)nUi. (12) 

k 

we say the network is closed. All trajectories near a closed network cannot leave a neighbourhood 
of the network. In such a case the dynamics of the system is well described by the network even in 
the presence of small perturbations to the system. We illustrate such a network schematically in 
Figure [21 

If a network is not closed, we only have 

£m>^£{B{A,)nUi) (13) 
j 

and such a network of unstable attractors Ai may still manifest itself in transients. If there is a 
proper inequality in (|13j) then a positive measure of initial conditions starting near the network are 
not asymptotic to states that are in the network. 

A network is called transitive if there is a directed path between any two attractors. An arbitrary 
closed network will contain subnetworks that are transitive networks of unstable attractors. 

2.5 Unstable attractors from saddles 

We briefly demonstrate that one can obtain unstable attractors from smooth semiflows with saddles 
by including small perturbations that induce collapse onto their stable manifolds. 

Consider a hyperbolic saddle equilibrium xq G M for a (non-invertible) semiflow Ft : M ^ M 
on a compact M with stable manifold W^{xo). We say Ft exhibits collapse onto the stable manifold 
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Figure 2: A closed network of unstable attractors. The unstable attractors Ai may form a network 
where a link from Ai to Aj implies that the basin B{Aj) intersects every neighbourhood of Ai in a set 
of positive measure. In the example sketched above, there is a transitive subnetwork {^2,^3,^4}. 



of xq if there is an open set U (z M and a T > such that Ft{U) C W^{xq). Since xq is a saddle, 
and has thus an unstable manifold, such an U cannot contain xq. Similarly, one can define collapse 
onto the unstable manifold of a saddle xq. This can occur on a neighbourhood that includes xq and 
in this case U may contain xq. 

An example of an unstable attractor constructed by using a pair of saddle equilibria is shown 
in Figure 01 this is essentially the mechanism that causes the appearance of unstable attractors in 
the system we discuss in Section |21 If there is a connecting orbit from xi to xq then collapse onto 
the unstable manifold of xi is simultaneously a collapse onto the stable manifold of xq; the points 
in the open set V intersecting the unstable manifold of xi tend to xq. Unstable attractors in this 
sort of scheme can be robust to perturbations of the system if the connecting orbits are in invariant 
subspaces. 

2.6 Networks of unstable attractors and heteroclinic networks 

Smooth dynamical systems with symmetries can exhibit heteroclinic cycles or homoclinic cycles as 
robust Milnor attractors, if the connecting orbits lie within symmetry-forced invariant subspaces; 
see for example |7| [H]. We indicate briefly how one can use these to construct a large class of 
systems that have networks of unstable attractors. 

Consider a smooth semiflow Ft : M ^ M on M with an absorbing open region R E M" such 
that the only Milnor attractor in R consists of the set 



For hyperbolic saddle equilibria Xi and the unstable manifolds We assume that the unstable 

manifolds are one dimensional and write the connecting orbits from Xi to xj by 



Given such an attractor S, we can construct piecewise smooth semiflows Ft : M ^ M such that 
the set of Xi forms a network of unstable attractors, and such that Ft and Ft are identical except 
on a set of arbitrarily small measure. 




(14) 




(15) 
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Figure 3: A semiflow on the plane with two saddles; xq is an unstable attractor. The set Cqi = 
W^{xi) n W^{xo) is a heteroclinic connection from xi to xq. We assume that the open set V in 
the neighbourhood C/i of another equilibrium xi collapses in finite time onto the stable manifold 
W^{xo) = B{xo) of Xq. Hence £{B{xo)) > 0; moreover, almost all perturbations to xq within Uq 
will leave Uq and so xq is an unstable attractor. 

To do this, pick a section Sij to each connection Cji 7^ and a neighbourhood Uij of Sij of 
arbitrarily small measure. Define Ft to be a semiflow that is equal to Ft when the trajectories are 
outside of the Uij. On entering the Ui we require that the semiflow collapses onto the connecting 
orbit in finite time, as illustrated in Figure \^ The illustration depicts this for one-dimensional 
connections but there can clearly be higher-dimensional connections with qualitatively the same 
features. 

Note that robust networks of unstable attractors can appear under the same conditions as for 
robust heteroclinic attractors [7j by adding collapse onto unstable manifolds because in this case 
unstable manifolds are contained within stable manifolds of other saddles. This can arise in cases 
where there is a discontinuity in the semiflow, but we note that it is not necessary; one could 
construct an unstable attractor similarly to Figure 01 for a smooth semiflow, as long as this maps 
some open set onto a zero measure subset of the stable manifold of xi. 

3 Oscillators with delayed pulse-coupling: 

a rigorous reduction to a finite dimensional system 

In this section we consider the system of oscillators with delayed pulse interactions investigated in 
jl4j . First we will show that this system, although formally infinite dimensional, can be reduced 
under general assumptions to a finite dimensional system. The number of dimensions remaining 
depends on the system parameters. 
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Figure 4: From heteroclinic networks to networks of unstable attractors. (a) An attracting hete- 
roclinic cycle between three hyperbolic equilibria Xi can be locally perturbed in sets of arbitrarily 
small measure to obtain (b) a network of unstable attractors with the same connection topology. 
Here, trajectories entering the balls hit one of the connecting orbits after a finite time and continue 
out after a uniformly bounded time. 

3.1 From phase history functions to phases and firing times 

The system of oscillators we consider is technically a hybrid dynamical system. A hybrid dynamical 
system is defined by a smooth flow in some regions of phase space with boundaries; when the flow 
hits one of the boundaries it is then mapped instantaneously by a deterministic mapping to some 
other point on the boundary. A trajectory from a hybrid dynamical system hence consists of 
intervals of continuous evolution interrupted by events that may be discontinuous. An evolution 
of the system is a Zeno State [Hj (also referred to as a chattering state) if there can be an infinite 
number of applications of the map in some finite time interval; in such cases one needs to have 
extra rules to permit evolution beyond the first accumulation point in time of an infinite number 
of applications of the map. We will show that there are no Zeno states in the system considered 
below. 

Definition 6 (Phase History Functions) We define V to he the set of piecewise smooth 'phase 
history' functions (j) : (— oo,0] — > [0,1), s i— > (j){s) such that: 

(i) Well defined limit from below. For some discrete (possibly finite), monotone increasing set 
of Sk > 0, k £ N we have (/)(s) is smooth for s € [— Sfc+i, — Sfc). 

(ii) No Zeno states. If there are infinitely many discontinuities s^ then limfc^oo -sa: = oo. 

Note that (i) means that the limit from below (p{s'—) := Unisys' (t>{s) is defined for all s' < 0. 
Condition (ii) means that we allow no Zeno states in the past. The system ^1] of A'^ pulse-coupled 
oscillators with delay r, where the phase histories are cf) = (01, • • • ,4>n), is defined in terms of a 
semiflow on 3 cf) for all t > 

^f.V^ ^ (16) 

such that $i(0)(s) = (f){s + t) for all s < —t. On the interval s € {—t,0] the function <I>(((/))(s) 
is deflned below. The boundaries of the intervals on which the phase history function [<I>t((/))]j of 
oscillator i is smooth are now denoted by — Sj.fc(i) < 0, /c G N. 

If lims^s/_ (j)i{s) > 1 we say oscillator i fires at time s'. Given that the system has evolved a 
time t from some initial condition (f> G at time 0, we list the past firings — cxj^fc < of oscillator 
i as 

• • • < -(Ti,3{t) < -(^i,2{t) < -(ri,i{t) < (17) 
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such that the (Ji^k{t) are the times since the jth last firing of the ith osciUator before or at time t. 
Note that the cjj^fc, /c € N count the firing events whereas the Si^t, A; G N count all discontinuities 
that may occur. We write the phase of the oscillator i as (pi = (j)i{0), namely as the most recent 
point in the phase history of that oscillator, and the previous firing times as ai^k- 

The future dynamics will be determined only by the present phases and the times of the past 
firings; formally there is a map n : ^ (M+)N such that 

Thus the map 11 o ^i(^(f))(^0) directly gives the current phases (piit) and the past firing times 
o'i,k{t), A; G N, of the oscillators z G {1, . . . , N}. Similarly, it will be useful to define a map onto the 
phases and the k past firing times: 

3.2 Definition of the semifiow 

The semifiow <I>j in ()16() is given as a hybrid system with continuous time evolution 

#1 = 1, ^ = 1 (20) 
dt ' dt ^ ^ 

for all i and k, except when one of a number of possible discrete events occur. 

These events are determined by a constant delay r > between one oscillator being reset 
and 'sending' a pulse ('firing') and its 'reception' by another oscillator. These events 'firing' and 
'reception' are the only types of discrete events interrupting the continuous time evolution. We say 
that at a time T 

• osciUator i fires, 
denoted Si, if (j)i(T—) = 1. 

• oscillator i receives a pulse from oscillator j, 

denoted Rij, if aj^k{T—) = t for some k and (f)i{T—) < 1. 

• oscillator i fires induced by reception of a pulse from oscillator j, 

denoted S^, if Rij and this results in an immediate firing of oscillator i (see below). 

Observe that for any i it is not possible that Si and Rij (for any j) occur simultaneously, 
whereas if Rij occurs it is possible that Rij', j' 7^ j also occurs at the same time. The phases 

cj>{t) = {4'i{'t))i£{i,...,N} aiid firing times a{t) = (o'j,fe)ig{i,...,Ar},fceN; and thus the evolution $t(0) 
occurs as (^0)) until one of Si, Rij or 5- occur at time T > t. By Definition El we take cj)i{t) G [0, 1) 
and ai,k{t) > for all i, k and all t. At such an event we define the new phases using the list below. 
One can verify that all variables stay in their respective ranges if they are started in that range 
and evolving in this way. 

• For each i such that Si occurs 
we set 

(pi{T) := 0, crj^i(T) := and renumber cri^k{T) := (Tj_fc_i(T— ) for all k >2. (21) 
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For each i such that Rij occurs 
we set 




UT-) + V{UT-),ei) 



e > 0, and 



(22) 



Ki = #{/e{l,...,A^} : ai,m{T-) 



T for I ^ i and some m} 



(23) 



is the number of 'input pulses' that arrive at time t = 0. 

• Once all the Rij have been checked, we say there is firing S[ induced by pulse reception if Rij 
occurs for some j ^ i and results in (j)i{T) > 1. In this case we set 4>i(T) := 0, ai^i(T) = 
and renumber ai^k{T) = fTj^fc_i(T— ) for all A; > 2, as if Si occurred. 

One can verify that the order of 'processing' simultaneous events with different i does not affect the 
final outcome; hence the map is well-defined. The condition I ^ i m. ()23() excludes self-interaction 
as in jl4 | I15 | HT)] which we will consider exclusively in the following. The response function V{(j)^£) 
expresses the response of an oscillator at phase cj) to an input e. 

The model is specified once the delay r > 0, the coupling strength e > and the function V 
are known. Observe that given an initial and ^(t) for < t < T we can define <I>r(0) the phase 
history at time T > 0. This way we complete the definition of (f))-{(j)){s) (|16|) for times s € {—t, 0]. 

For continuous functions 1/ : [0, 1] — > M we define their difference increments 



We say V is uniformly strictly monotonic increasing on [0, 1] if Ay ((/>, e) > for all < (/> < 1 (note 
that this implies that V{(f),£) is strictly monotonic increasing in (p). 

Definition 7 (Response Functions with Increasing Response) We define V be the set of re- 
sponse functions V : [0, 1] x [0, c] [0, oo) for some c > with V{(f),£) satisfying 

(i) Continuity: V{(j)^£) is jointly continuous in (p and e. 

(a) Zero response to zero input: V{(f),0) = for all (p. 

(Hi) Uniform strict monotonicity: For any fixed e > the function 1^(0, e) > is uniformly strictly 
monotonic increasing in (f) on [0, 1] . 

(iv) Upper bound linear in e: For any fixed e > 0, monotonicity ofV means there is a unique (pm 
that solves 



which gives the maximum response; we assume this is bounded above by a linear function of 
£. More precisely we assume there is a Vi such that 



Ay(0,e) : 



mm 

0<<t>'<l-<f> 



{V{(P' + <p,e)-V{<p',e)). 



(24) 



V{(pm,e) + (P^ = 1 



(25) 



V{(Prn,e) < Fie < 1 



(26) 



for all < £ < c. 
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Condition (iv) allows one to obtain a bound on the total change in phase over one period. Note 
that e) < Vi£ < 1 for all (p < (j)m and that for > cprn, the response V{(p,e) is such that the 
updated phase is supra-threshold, resulting in an induced firing; hence Vmax(e) = V{4'm,£) is 
the largest response to an input of magnitude e. 

We say that response functions V &V give increasing response because the response increases 
with (j). In particular, concave (down) potential functions give rise to this form of response (see 
Lemma 121 below). We give this space the structure of a metric space with norm 

\\V-V\\= max \VicP,E)-VicP,E)\ (27) 

(0,e)e[O,l]x[O,c] 

for V,V (zV. Closeness of V and V in this norm imply that both the functions and their differences 
increments are close, by the following Lemma. 

Lemma 1 Suppose that \\V — V\\ < 6; then ||Ay — Ay|| < 25. 

Proof: Suppose that \\V — V\\ < 5, fix e and drop the second argument of y((/>, e) for convenience. 
Then |V^(i;^>) — V^(0)| < 5 for all 0. The triangle inequality implies that 

{V{(p' + 0) - V{(p')) - (y(0' + </.)- y(0'))| < (28) 

for all (/)' and < 1 — 0'. For a given value of (j) there is a sequence {sn)n&i such that V[sn + 
(j)) — V{sn) — > Ay((/)) as n — > oo. By considering (j)' = Sn in we can conclude that Ay(0) < 
Ay (0) + 25. Similarly by considering (sri)neN such that V{sn + 0) — V{sn) ^yi^f) as n ^ cx) we 
have using (jSHJ that Av/((/)) < /^y{4>) + 25. This implies \^v{4>) - ^v{4')\ < 25 for all (p and e. □ 



The resetting rule 

4>^U-\U{(P)+e) (29) 

with a twice continuously differentiable 'potential' function U was considered previously \12l |1J 
El El to describe a phase jump induced by a reception (-Rjj) of a pulse of strength e. 
This 'Mirollo-Strogatz' case is a special case of the more general reception rule we use here, if we 
substitute 

V{^, e) = Vms(0, e) = U~HU{cl)) + e) - 0. (30) 

We now show that, if U is increasing concave downwards, this fits into the more general reception 
scheme of Definition |3 In Figure El we illustrate a typical choice of U and its consequence for V 
for given (j) and e. 

Lemma 2 Consider a response defined by Vms in \29i3fl\) where < e < c and U is an unbounded 
twice continuously differentiable function U : [0, oo) — > [0, oo) that satisfies U{0) = 0, U{1) = 1, 
< ci < U'{(f)) < Ci and -C2 < U"{(f)) < -C2 < for (f> e [0, 1] where c^, Ck (k = 1,2) are positive 
constants. Then Vms ^ V for small enough c. 

Note that the details of the definition of U are only critical in the range [0, 1]. This is because 
any time that U > 1 we will get resetting; the definition on (l,cx3) is simply for expositional 
convenience. 
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Proof: One can directly verify that the conditions (i)-(ii) in the definition of V are satisfied. To 
show (iii), note that U monotonic increasing and surjective on its range means it has a unique 
inverse that is also monotonic increasing. To see that (iii) also holds, first observe that 

1. (31) 



' [/'([/-i([/(0)+e)) 

The condition [/' > means that U is strictly monotonic increasing. The condition U' < Ci means 
that U{(/) + x) < U{(/)) + Cix for all x satisfying < x < 1 — (p. Together with the monotonicity of 
we obtain, substituting x = e/Ci, 

U-\u{cP)+e)>cP+-^. (32) 

Similarly, U" < means that U' is monotonic decreasing; U" < —C2 implies U'{(j)) > C2e/Ci + 
U'{(l) + e/Ci) for all (/> and thus, using (jSH), 

U'{<p)>U'iU-\U{<p)+e)) + ^e. (33) 



Substituting into this leads to 



U'{ ct>)-U'{U-\U{^) + e)) C2_ 
U'iU-HUi<P)+e)) Cf 



d^yi<p^ ^) = ^7J.;-;;...;r:"\:^^ > > o. (34) 



Hence for fixed e > we have 

r<l>'+<P 

\V{4>' + (t>,e)-V {((>', e)\= / 

Jcj,' 



{d^V){s,e)ds 



> e%(t^ > (35) 
^1 



for all 4> > 0, and so (iii) holds. Finally, to show (iv), note that for V = Vms Eq. ()25() . which 
determines 0m, becomes U{(prn) + e = 1 so that by definition the maximum change at a reset 
is 

V^^,{e) = l-U-Hl-e). (36) 
Clearly, Vms(</', e) > for all e > 0. Moreover, Vma.x{^) < 1 by definition (Eq. (jHH)), 

ft = > (37) 



8.=V„.x(e) = „„,,, ,,. ^ < (38) 



and 

U"iU-Hl-e)) 
[U'iU-Hl-e))Y 

because U' > and U" < in the relevant range. Thus Fmax(£) is increasing and concave and 
so we have the linear upper bound Knax(£) < Vie where Vi = 9elmax(0). □ 
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0.2 0.4 ([, 0.6 0.8 1 

Figure 5: Plot showing [/(</>) satisfying the conditions for Lemma [21 that hence giving a resetting 
function V{(j), e) with increasing response. U{(j)) in this case is defined in ([5n|l with 6 = 3. 

3.3 Finite dimensional dynamics in finite time 

We proceed to show that the system of pulse coupled oscillators with increasing response will reduce 
to a finite dimensional system for an open set of parameter values. Theorem ^ gives an estimate 
k for the largest number of 'past firings' one needs to consider in the limit of large time. We can 
effectively reduce to a system of dimension at most N{k + 1) after a finite time. The proof works 
by considering the maximum number of resets that can occur to an oscillator in any time interval 
[0,r]. This depends on the number of firings that occurred in the previous time interval of the 
same length, giving the recurrence inequality in Lemma 0] 

We reduce the dynamics from a hybrid delay differential equation with infinite dimensional 
phase space to a finite dimensional system by restricting to phase histories of the form: 

= {0 € V'^ : crj,k+i > T for all j € {1, . . . , A^} for which a cxj^fc+i exists} (39) 

namely, those that have at most k firings within the delay time r. 

Lemma 3 Suppose that and are in and Ylkcf) = lik'^. Then 

Hk^ti^) = lik^tii') (40) 

for all t > 0. 

Proof: This result states that any two initial states in whose past k firings and phases are 
the same will have precisely the same phases (and hence firings) at all times in the future. This is 
because by definition all firings beyond the kth in the past will not affect the future phases. □ 

The previous Lemma does not necessarily imply that ^t{4^) G '^k ■ 

Theorem 1 Suppose that V ^V. Then there is a k > 1 (depending on e, r and V) such that for 
any cf) G there is a finite T > (depending on cf), e and V ) such that <l*t(0) € for all t > T . 
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Moreover, after time T the number of firings of an oscillator that can appear in any time interval 
of length r is at most 

1 + T 



where \_x\ is the smallest integer less than or equal to x. 



(41) 



For any k such that the conclusion of Theorem ^ holds we say the dynamics reduces to . We 
prove Theorem^using the following Lemma. For any initial condition 4> ^ let ^ = ^mT{4') 
{m G {0, 1, 2, • • • }) and suppose that the number of firings of 4> in the interval [— r, 0) is k^- 

Lemma 4 For all m we have k^ < [1 + r + km-iVie\ 

Proof: Suppose that there have been at most /cq firing events of each of the N oscillators during 
the time interval [— r, 0). Consider the events that affect the phase of an arbitrary oscillator 
i € {1, . . . , A^} in the future time interval [0,r); there will be no(i) events in [0,r) where at each 
event Nn, N — 1 > Nn > 1 pulses of the oscillators j ^ i are simultaneously received by i. 

The total number of received pulses is Yln=i < ^o(-^ — !)• The total change A0j in phase of 
oscillator i up to time r is hence at most 



n=l 



Hence oscillator i will have fired at most 

ki = [l + T + koVie\ 



(42) 



(43) 



times in the interval [0, r). Since i is arbitrary, we have in general at most km < [1 + r + km-iVie\ 
firing events of each oscillator in the interval [r, 0] and the Lemma follows. □ 



Proof: (of Theorem^ Since Vie < 1 applying Lemma 0] inductively we have 

km < ko{Vier + il + T){iVier'-^ + iVier-^ + --- + iVie) + l) 



(44) 
(45) 



and so because (Vie)™ — > 0, after some finite time T = mr (which can be estimated from (|45jl 
given ko) we have 

1 + r 



km. k 

1 — Vie 

The remainder of the theorem is a consequence of applying Lemma El 



(46) 
□ 



The estimate of k will typically be a very poor upper bound. If the number of oscillators A'^ is 
small one can improve on these bounds by noting that the pulses are 'quantized' into multiples of 
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£/{N — 1). In particular, one can replace the upper bound ()26() by requiring only that there is a 
Vi such that 

f ke \ ke , , 

V[0^,J^)<V,—^<X (47) 

for all 1 < A; 7^ {N — 1). For larger this approaches (|26() . 

As a consequence of Lemma H] we can now justify defining the dynamics as a semiflow on . 

Corollary 1 A system with V & V that satisfies Vie < 1 will remain free of Zeno states for any 
e > and r > 0. 

This is because, although the number of firings in an interval [0, r] can increase if Vie is large, 
the maximum rate is given in Lemma |1] and there cannot be infinitely many firings in any time 
interval of finite length. Another consequence of the proof of Theorem ^ is that the semiflow on 

has a restriction to that is a well-defined semiflow. 

3.4 2N dimensional state space in finite time (k = 1) 

In the case that 

1 + r < 2 - 2Vie, (48) 

we can apply Theorem ^ to see that 1 < (1 + t)/(1 — Vie) < 2, and so /c = 1. In fact, this is not 
a very tight estimate, and in many cases where (|48|) does not hold the dynamics still reduces to 
k = 1. For a particular initial condition one can practically check the dimension it reduces to by 
finding the lim sup of the number of firings of one oscillator in any time interval of length r for a 
neighbourhood of that initial condition. 

If at most one previous firing is needed to determine the phases uniquely in the future, the 
dynamics reduces to a semiflow on a 2A^ dimensional space 

ni{V^) ={{(l)i,--- ,^N,cTi,--- ,(Tn) : </>i G [0,1), cTi G [0,oo)} 

where we write fij = cij^i in shorthand. For the oscillators we consider, the semiflow 

$i : ^ (49) 

for t > is well defined for e and r small enough; Appendix Ogives an explicit form on this reduced 
space. 

4 Unstable attractors for pulse-coupled oscillators 

The main result in this section is a proof that unstable attractors exist and are robust in the system 
of delay pulse coupled oscillators discussed in Section |21 

4.1 Unstable Attractors: Existence and Robustness 

For this section we consider the potential function 

Ui^) = Ubi<p) where C/fe(0) = ^ ln(l + (e*- - 1)(/)) (50) 
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used in ^1]. Computing the associated response function V defined by H3U() we find an affine 
relationship between (p and V: 

V{^,i) = ^^+[e''>-l)<P (51) 

and one can check that V (z V; this is a particular case of Lemma |21 the relationship between U 
and V is illustrated in Figure |SJ 

Theorem 2 Consider the system of oscillators defined in Section \S. gl with U defined by i5(]\) with 
N = 4:, r = 0.14 and e = 0.24 and 6 = 3. This system has a periodic orbit that is an unstable 
attractor with zero measure local basin. 

Proof: By applying Theorem ^ one can directly verify that any initial condition € "P^ will reduce 
to the 4(1 + 4) = 20 dimensional space HiiV^) after a finite time, i.e. such that only the phase 
and last four firings of each oscillator contribute to the dynamics at any point in the future. Now 
consider the open set of initial conditions defined by 

{(f)i,- ■ ■ ,(j)4,ai,- ■ ■ ,(T4) <^ Co (52) 

where 

Co = (0.7, 0.7, 0.3, 0.95, 0.5, 0.5, 0.5, 0.5) + [0, 0.001]*^ C Hi {V^) . (53) 

As a slight abuse of notation, we will also write Cq as meaning n^^(Co) if the context is clear. 
Note that all the crj > r = 0.14, meaning that Cq C Vf. Theorem ^ means that at points in the 
future we may in principle arrive at states that are in for fe = 4 but not for A: < 3. However, we 
win verify below that $t(Co) C for alH > 0. 

Note that H^^Cq is an open set, as is its image under 11^ is open for any A; > 0; we will show 
that it is in the basin of attraction of a saddle periodic orbit. In what follows we write Ck to denote 
the kth. intersection of the trajectories in Cq with one or more of the 'events' Si or Rij. Since the 
information about the original initial condition of the dj has been lost we list only the first four 
components. We compute that 

Ci = [0.749,0.751] X [0.749,0.751] x [0.349,0.351] x {0} (54) 

due to the first event being 54. The next event is i?4 which will give 

C2 C {(0,0, </>3, 0.14) : </>3 G [0.63,0.64] } (55) 

and so we have reduced to a one dimensional subspace of phase space at this point. A very tedious 
direct numerical verification listed in Table Q shows that all of the points starting in C2 after a 
further 32 events reach a single point 

C34 = {P} with P := (0,0, a, a, 0,0, 6, 6) (56) 

where a ~ 0.62307 and b ~ 0.57088 can be computed exactly (see Appendix B). We present in 
Figure El the values of the coordinates depending on choice of (j)^ over a larger range than in C2; 
observe that a one dimensional set of possible initial values converges to exactly the same point. The 
point P (|56|) is a cross section to a periodic orbit where two pairs of oscillators remain synchronized. 
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k 




01 




02 




03 




04 




0"! 




(^2 




"■3 




0-4 








70000 





70000 





30000 





95000 


1 


00000 


1 


00000 


1 


00000 


1 


00000 


1 





75000 





75000 





35000 





00000 


1 


05000 


1 


05000 


1 


05000 





00000 


2 





00000 





00000 





63712 





14000 





00000 





00000 


1 


19000 





14000 


3 





19219 





19219 





00000 





48478 





14000 





14000 





00000 





28000 


4 





43650 





43650 





14000 





80846 





28000 





28000 





14000 





42000 


5 





62804 





62804 





33154 





00000 





47154 





47154 





33154 





00000 


6 





99058 





99058 





61365 





14000 





61154 





61154 





47154 





14000 


7 





00000 





00000 





62307 





14942 





00000 





00000 





48095 





14942 


8 





19219 





19219 





00000 





50000 





14000 





14000 





00000 





28942 


9 





43650 





43650 





14000 





82781 





28000 





28000 





14000 





42942 


10 





60870 





60870 





31219 





00000 





45219 





45219 





31219 





00000 


11 





96599 





96599 





58906 





14000 





59219 





59219 





45219 





14000 


12 





00000 





00000 





62307 





17401 





00000 





00000 





48620 





17401 


13 





19219 





19219 





00000 





53974 





14000 





14000 





00000 





31401 


14 





43650 





43650 





14000 





87833 





28000 





28000 





14000 





45401 


15 





55817 





55817 





26167 





00000 





40167 





40167 





26167 





00000 


16 





90176 





90176 





52483 





14000 





54167 





54167 





40167 





14000 


17 





00000 





00000 





62307 





23824 





00000 





00000 





49990 





23824 


18 





19219 





19219 





00000 





64354 





14000 





14000 





00000 





37824 


19 





43650 





43650 





14000 





00000 





28000 





28000 





14000 





00000 


20 





74709 





74709 





37016 





14000 





42000 





42000 





28000 





14000 


21 





00000 





00000 





62307 





39291 





00000 





00000 





53291 





39291 


22 





19219 





19219 





00000 





89350 





14000 





14000 





00000 





53291 


23 





29869 





29869 





10650 





00000 





24650 





24650 





10650 





00000 


24 





43650 





43650 





14000 





05679 





28000 





28000 





14000 





03350 


25 





70451 





70451 





32758 





16330 





38650 





38650 





24650 





14000 


26 





00000 





00000 





62307 





45879 





00000 





00000 





54199 





43549 


27 





19219 





19219 





00000 





99996 





14000 





14000 





00000 





57549 


28 





19222 





19222 





00004 





00000 





14004 





14004 





00004 





00000 


29 





43650 





43650 





14000 





19214 





28000 





28000 





14000 





13996 


30 





56917 





56917 





19224 





19218 





28004 





28004 





14004 





14000 


31 





00000 





00000 





62307 





62301 





00000 





00000 





57087 





57083 


32 





19219 





19219 





00000 





00000 





14000 





14000 





00000 





00000 


33 





56912 





56912 





19219 





19219 





28000 





28000 





14000 





14000 


34 





00000 





00000 





62307 





62307 





00000 





00000 





57088 





57088 



Table 1: The state of the system at times of the feth event on a trajectory starting with an initial 
condition in Cq (see equation ()53|1 in the proof of Theorem [21) the phases 0j and firing times crj 
defining the state at the event times are shown to five decimal places. All initial conditions in Cq 
finally arrive at the same point in C34 because of the firing-induced resetting at stages k = 2 and 
k = 32. 
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Figure 6: Dependence of dynamics on the initial phases (0, 0, (/)3, 0.14) € C2. Panel (a) shows 
the phases ((/>i(0)5 02(x)i 03 (D), (/'4(+)) after 32 further intersections with discontinuities of 
the semiflow ('events') in dependence of Observe that there is a large range of ^j, for which 
the dynamics arrives at precisely the same point. Panel (b) shows the actual attractor reached 
from the above initial conditions (shown after the 52"*^ reset of oscillator i = 1. Surprisingly, 
the same attractor is reached by several initial conditions whose trajectory after 34 events differs 
substantially. 

Since the periodic orbit through P contains the open set Co in its basin it is a Milnor attractor for 
any reduction of the system to finite dimensions, for example to Vf. 

Now we show that the orbit through P is unstable. In order to do this we show that almost all 
perturbations of the first two coordinates grow to finite size under the action of the local return 
map. A complete stability analysis is presented in the Appendix^ In particular, as is shown 
below, this proves instability in general, not only linear instability. 

In this analysis we consider the return map from the plane (p2 = to itself. The pulses ai are 
kept locked to the phases (pi such that the nonlinear return map ()81() 

6' = F{S) (57) 

is three-dimensional and maps a perturbation d := {61, 63, 64) := 0(0) — <^*(0) to the periodic orbit 
started at ((^. 

0*(O) = (0,0,a,a) (58) 

to the perturbation S' when the plane 02 = is reached the next time. 

If we take a general perturbation (satisfying 5i 7^ S2) just before arriving at (0,0, a, a), observe 
that the are all larger than r and hence will not affect the future of the phases. Starting with such 
a perturbation, when it hits the next event we can arrive at an arbitrary perturbation satisfying 
61 > 62 = such that immediately after the perturbation, events occur in the order 81,82, {8'^, 8'^). 
Note that the order of the events 83 and 5*4 does not play a role as they become synchronized at 
their first firing. 

As demonstrated explicitly in Appendix B, there is a small A* > such that the return map 
H57() defined in the three-dimensional region 

n={S : 5i > <52 = and \5^\ < A* for all i G {1, 3, 4}} (59) 
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is given by a smooth map with F(0) = (and such that F(7^) is a hne that intersects TZ). In 
particular, given the map F(^) in terms of an arbitrary function V £ V (see Appendix B) we 
analyse of the fully nonlinear local dynamics of a sufficiently small perturbation S = (5i,0, 0), 
< 6i < A*, to the periodic orbit. For the following estimate, we write A^((f)) for Ay((/), e) in 
shorthand notation. First note that requirement (iii) in Def. [7| implies that there is a Ai;{5) such 
that for all 5 > 0, H^{(j) + 6) — Hf,[(j)) > 5 + ^e{^) for all e > 0, in particular, is monotonic 
increasing in (p. This implies that 

Fi{8) = H2i{He{T + 6i)+T) - H2e{He{T-8i) + T + 5i) 

> H2i{He{T) + di + Ae{6i) + T) - H2i{Hi{T) - Ai{6i) + t) 

> 6i + Asi6i) + A2ii6i + Agi6i)) + A,~(5i) + A2,-(A,-(<5i)) ^"""^ 

> 6i + 2Ai{6i). 

Hence we find that Fi{S) > 5i + 2Ai{6i) implies that any perturbation d = ((5i,0, 0) satisfying 
5i > increases (e.g. in maximum norm). Because the function Ai{5) is non-decreasing in 6, we 
see that there is a A* > for which any sufficiently small perturbations (satisfying \5i\ < A*) leave 
the region TZ in finite time tn, bounded by 

By the permutation symmetry of the system, the analysis in the case (5i < ^2 = is analogous. 
This means that almost all sufficiently small perturbations S leave a neighbourhood of the attractor 
in finite time, proving that the attracting periodic orbit considered is also unstable. The case 82 < Si 
can be treated analogously by the symmetry of the globally coupled network. Taken together there 
is a neighbourhood TZ' of 3 = such that all points starting in TZ' with 5i = 62 will iterate 
away until they leave this neighbourhood. This proves instability of the orbit through P (|56)1 . □ 



Figure |7| shows the dynamics starting from one initial condition ()53|) used in the proof of the 
theorem. The convergence in finite time to the attractor is seen. A small random perturbation to 
the phases of all oscillators is expanded by the instability, yielding convergence towards another 
attractor. 

Theorem 3 The unstable attractors of Theorem are robust in the sense that there is an open 
neighbourhood in V of V{x,£) = Hi{x) — x given by llSfjt5(]\) and an open neighbourhood of (r, e) 
such that a system defined by any V , f, and e in these neighbourhoods, has an unstable attracting 
periodic orbit that remains close to that of Theorem\^ 

Proof: We refer to the return map F (|81|) derived in the Appendix B and already discussed 
in the proof of Theorem |2 Note that in the derivation of the return map F, the form of the 
transfer function H and the precise values of the parameters r and e are not important, because F 
continuously depends on H, r, and e and changes its form only if the sequence of events occurring 
along the trajectory on or near the periodic orbit is altered. Thus, an equivalent periodic orbit 
exists if the dynamical system is slightly perturbed, i.e. if H, r, and e, are slightly changed from 
their original values. In particular, one can choose -ffe(0) = (j) + V{4>, e), where V is sufficiently close 
to the original. Since the mechanism of dimensional reduction and attractivity depends only on 
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Figure 7: A four oscillator network {N = 4, e = 0.24, r = 0.14, U = Uh, 6 = 3) exhibiting an 
unstable attractor. At time zero, initial phases in Co are shown. The time axis is discrete and shows 
the phase when oscillator i = 2 fires. Just after the firing event 5*2 of oscillator i = 2 at times tn, all 
phases 4>i{tn) are plotted (0i(O)! '^2(x)j 4>3 (D), <^4(+)). There is convergence of the trajectory in 
state space in finite time towards the periodic orbit passing through ((S^ . An instantaneous small 
random perturbation < 10^^) to the phases at time n = 20 leads to a switching to another 
attractor, demonstrating instability of the original periodic orbit. 

the supra-threshold synchronization mechanism given by the induced firing events S"^, the slightly 
perturbed periodic orbit will also be an attractor. Moreover, for a sufficiently small perturbation 
to V, T, and e we still obtain 

Fi{S) > 2Ai{6i) + 6i if A* >5i> 0, (62) 

which implies instability, (cf. the proof of the previous theorem). Again, since the return map 
F does not change form if the parameters H, r, and e are slightly perturbed, also the proof of 
instability is independent of these parameters of the system. This completes the proof. □ 



This result implies that qualitatively the same dynamics is obtained by any flow defined by a y 
nearby the original V ()3U() : in particular it does not have to be defined in terms of a any potential 
function U by (pO]) . 

4.2 Interpretation in terms of dimension jump 

Since the proof of Theorem |21 is rather involved, we discuss some intuition in terms of what we 
term a dimension jump of the semiflow. Given a semiflow : M ^ M that is not invertible, one 
can nevertheless define, for all x G M, a set-valued inverse for any t > by 

^-t{x) = {yeM : ^t{y) = x} (63) 

and the semiflow can be extended uniquely to an invertible flow precisely when <I>_f(x) is a single 
point for all x and t > 0. Given sufficient regularity on for example sufficient to ensure that 
^-t{x) is a union of manifolds, we can compute its dimension. If all <I>_t(x) are non-empty then 
dim($_t(x)) will be a non-decreasing function of t. The dimension jump 

j{x) = lim (dim(<I>j(x))) (64) 
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Figure 8: Schematic showing a point x that has a unique inverse ^-uix) for < u < t. If we define 
y = $_t(x) then y is in J the jump set (in this case j{y) = 1) and for any t < s the dimension of 
the set is greater than zero. 

at X is of particular interest and we refer to 



as the dimension jump set, shown schematicahy in Figure |S1 Such behaviour can be found in 
systems exhibiting shding modes [TH], and we suggest that such systems may display unstable 
attractors. 

Observe that trajectories converging to an invariant set that pass through J may cause locally 
unstable invariant sets to be unstable attractors. For the system of delay coupled oscillators with 
k = 1 there are two events on which dimension jump can occur: 

1. For one of the firing events Si or S'^ we lose dependence on the delayed phase cij. 

2. At a resetting Rj that induces firing in two oscillators S[_^ and S'^^ we synchronize the oscillators 
ii and i2 beyond that point; this also causes a dimension jump. 

In out system, these events have 'jump sets' that are codimension one and typically they cause a 
loss of one dimension; however when the oscillators become synchronized, several such events can 
occur at once resulting in a loss of more dimensions. 

The proof of Theorem [21 works by choosing an open set of initial conditions that reduces di- 
mension down to one dimension after two further discrete events. The final loss of dimension that 
reduces the open set down to one point in the section occurs only a while later, and this is because 
there is a global connection in phase space that we need to follow. 

5 Discussion 

In this paper we give a rigorous definition for a novel type of Milnor attractor, the unstable attractor, 
introduced in |141 116j . We classify these attractors in terms of presence or absence of local basin. 
These attractors are surprising in many ways; notably they have 'local repelling' properties in that 
they have neighbourhoods such that almost all points leave the neighbourhood after a finite time. 

We show that unstable attractors not only exist, but even appear robustly in certain classes 
of hybrid dynamical systems of interest as physical and biological models; namely in networks 
of pulse-coupled oscillators. The robustness that we have demonstrated is limited in the sense 
that we only consider perturbations that keep the time delay identical for all connections and 
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the coupling function identical for all oscillators. We do not consider perturbations that break 
the identical nature of the oscillators or the symmetry of the system. On introduction of such 
general perturbations we expect no robustness for such unstable attractors, although one may 
obtain attractors that remain 'nearby' to where a network of unstable attractors used to exist, i.e. 
close to a collection of unstable periodic orbits and their heteroclinic connections. 

For perturbations that break only part of the symmetry, unstable attractors may still persist. 
For instance there is numerical evidence that unstable attractors can still exist even the network is 
not coupled all-to-all, cf . ^\ . The exact consequences of non-identical oscillators and more general 
broken symmetry remains to be studied. 

If we perturb the system in such a way that it becomes smooth and invertible, the unstable 
attractors will disappear; any saddle periodic orbit will have a zero measure basin simply by exis- 
tence of a global stable manifold of dimension less than that of phase space; however as indicated in 
Section 121 one should be able to make the system arbitrarily differentiable and still obtain unstable 
attractors, as long as non-invertibility is retained. 

In Proposition H we have shown that certain conditions on a general dynamical system exclude 
the possibility of unstable attractors with zero local basin. To generalize this finding to also exclude 
unstable attractors with positive local basin, we believe it will be necessary to strengthen these 
conditions. Generalization of our result is not straightforward because a (local) basin may be highly 
irregularly, as for riddled basin attractors. 

Our proofs of the main results are not very elegant; this is because they rely on global features 
of the hybrid dynamical system, and we have not found them easily reducible to simpler arguments. 
We believe however that it should be possible for exact numerical methods to identify when 
unstable attractors are present in such systems. 

The numerical results in suggest that networks of unstable attractors exist in a wide range of 
systems of pulse-coupled oscillators. Preliminary studies have shown that the networks of unstable 
attractor may often be transitive for a wide range of parameters and system sizes. Revealing 
the mechanisms underlying the existence, structure and prevalence of such networks of unstable 
attractors is a challenging task for future research. 
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A Explicit form of the semiflow for k = 1 

We give the semiflow of globally coupled oscillator networks explicitly for the case A; = 1 by the 
following algorithm. Consider (0, a) = (01, . . . , (/)jv, cji, . . . , ajy) € ni('Pf^) where the ith component 
represent the ith phases and the n-|-ith component represents the time since the ith oscillator fired. 
Suppose that ^t{T^i) C Vi for all t > 0. We note that we can represent the flow on Iii{Vi) by 
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for all < t such that < 1 and fij < r. After time 



T((/), a) = smallest positive value in (1 — r — o"j : z G {1, . . . 



N}) 
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we hit the first event and apply a mapping according to the following algorithm: 

• Set {(p, a) ^ {(p, a) + r(0, cj)(1, • • • , 1). 

• For each i such that cjj = r we say Rj occurs for all j ^ i and set (pj(T) = (j)j(T~) + V{<j)j,i) 
for i defined as in ((^ . 

• If there is an i such that (/>j(r) > 1 then we say Si occurs and set 4>i(T) := and (7i{T) := 0. 

After applying this algorithm we are assured that T{(j), a) > 0, as (pi(T) G [0, 1) and (Ji{T) ^ r for 
i = l..n. Thus we can take this state as a new initial condition and rerun the algorithm sequentially 
from event to event. 

B Return map near unstable attracting periodic orbit 

For the main results of this paper (Theorems 2 and 3) we use a nonlinear return map F(S) of 
perturbations S to the unstable attracting periodic orbits in a network of = 4 oscillators using 
the semiflow detailed in Appendix We detail the derivation of this return map and analyze the 
periodic orbit that is the unstable attractor. 

We choose (j)2(to) = where to = 0, and consider cases where the initial aij > r. First we 
analyse the dynamics on the periodic orbit. To establish instability we then consider, without loss 
of generality, perturbations to the periodic orbit phases at a point on the orbit where the time 
since last pulse is greater than r for all oscillators. This means that the future depends only on 
the current phases and we can effectively consider (j)i{t) — (Tj^fc(t) = const for all i G {1, 2, 3, 4} and 
all t satisfying ti < ai^k{t) ^ ^2 where ti defines the time of the last event such that Ui^k{ti) = 
and t2 > ti the time of the next event analogous to (|67() . Within this convention, we consider the 
return map from the three-dimensional plane defined by 02 = to itself and establish instability 
for this return map to prove instability of the periodic orbit. 

The following analysis applies for the parameters e = 0.24, r = 0.14, and the function U = 
(|5(H) where 6 = 3. It will turn out that it also applies for a neighbourhood thereof, showing 
robustness of the instability of the periodic orbit. For compact notation, we introduce the transfer 
function 

HM = V{cP,e)+^. (68) 

This transfer function mediates the action of an incoming pulse of strength e on the phase (j). We 
obtained the sequence of discrete events and the numerical values in the following analysis for the 
specific choice pOISOf) . 

B.l Periodic orbit dynamics 

First we determine the dynamics of the unperturbed orbit (Table I^J. Throughout the table, the 
phases after each event are labelled pi^k where the first index labels the oscillator i G {1,2,3,4} 
and the second index counts the events k occurring for a perturbed trajectory (see Table 01 below) 
starting with k = for the initial condition (first row of Table [JJ. Since the second oscillators i = 2 
and i = 4 in the two synchronous groups have the same phases as the oscillators i = 1 and i = 3, 
respectively, we define p2,fc := Pi,k and p^^k '■= P3,k for all k. We show that the unperturbed orbit 
indeed is periodic with period 

r = 2t + 1 - pi,3 (69) 
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Event 


t 




Si, S2 





a 
= : Pi,0 =■■ P3,0 ~ 0.62307 


-Rl, i?2, 5*3, ^4 


r 


1 - 

= : Pi,2 

= ■ P3,2 




2r 


H2iiPi,2 + r) F,-(t) 
= : Pl,3 =■ P3,3 


Si, S2 


2r + 1 - pi,3 


^ Q f'a.s + 1 - Pi,3 

n ^ =-^3,5 
0=:pi,5 ! 

= a 



Table 2: Events occurring during one period of one of the unstable attracting periodic orbits in 
the system of four coupled oscillators (see text for explanation). 

given by the time t in the last row of Table EJ where 

pi,3 = H2i{He{T) + t) (70) 

is also read off the table. Here we use the abbreviation e = £/{N — 1) for the strength of an 
individual pulse. 

Table 121 displays the time evolution on the periodic orbit event by event. The left column gives 
the sequence of events, labelled Si if oscillator i sends a signal and Ri if the signal from oscillator i 
is received by all other oscillators j ^ i (for conciseness we write Ri here instead of {Ri^j\j 7^ i}). 
The second left column gives the time of occurrence of these events. The right two columns give the 
phases (j)i of oscillators i £ {1, ... ,4} just after the events have occurred, where the synchronized 
oscillators have identical phases, (/)i(t) = (p2it) and (psit) = (j)4{t). The first row gives the initial 
condition at t = 0, just after the signals of oscillators i = 1 and i = 2 have been sent. Si, 5*2. The 
initial phases 

<f>{0) = {0,0,a,a) (71) 

are given in the first column with constant a « 0.62307 used in Section|3 equation and defined 
below, Ea. (f7n|l . 

In general, at time t the time interval to the next event is given by the minimal distance of any 
phase to threshold. 

Ail = min{l - 0,(t) I i G {1, . . . , 4}}, (72) 

or by the time 

At2 = min{r — (7i^k{i) \'i G {!)•••) and k such that ai,j{t) < r} (73) 

until the next signal arrives, depending on which Atj is smallest at any given time t (cf. App. A). 

As an example of the event-based dynamics, consider the event A; = 2 at time t = t. This event 
contains the reception of signals sent by oscillators i = 1 and i = 2 at time t = 0, Ri and i?2- Since 
there are no self-connections, these oscillators receive only one signal each such that their phases 
are shifted according to 

Pi,2 = Heir) (74) 
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for i G {1, 2}. At the same time t = t the other oscillators i = 3 and i = 4 receive two signals of 
total strength 2e making them superthreshold, U{pifi + t) + 2i > 1 for i € {3,4}, such that they 
experience a reset, denoted 1 — > 0, and 

P3,2 = P4,2 = 0. (75) 

Here, one incoming signal would not have been sufficient to reach the threshold, 

U{p^,o + T)+i <1, (76) 

for i G {3,4}. This ensures that the return map (|8H) for perturbations to the periodic orbit is 
continuous. 

Going through the table row by row, the phases proceed (with time) from event to event. The 
last row gives the phases just after oscillator i = 2 has been reset again, 

MT)=P2,5 = 0, (77) 

after period T = 2r— l+pi^3. The actual parameter dependence of the constant a is then determined 
self-consistently from the condition 

P3,5(o) = a (78) 

for the orbit to be closed. This leads to 

a = He{r) + l-H2e{Hi{r)+T). (79) 

B.2 Dynamics of a general perturbation to the periodic orbit 

Here we consider the dynamics of a general perturbation applied to the periodic orbit studied above. 
By general perturbation we mean that the initial phases 

(/.(O) = (0,0, a, a) + (51,(52,(53,(54) (80) 

satisfy (l)i{0) ^ ^2(0). To be specific we assume 8\> 82 = 0. Whether or not (^-ii^i) = 04(0) does not 
play a role. Pulses are then sent by the network in the cyclic order 6*1, ^2, (Sg, ^4). This assumption 
is made without loss of generality because of the permutation symmetry; the case (^2 > (5i = can 
be treated analogously. We consider only perturbations of firing events that are locked to the phases 
such that the firing time variables Oi^y^it) are unimportant as discussed previously. The changes of 
the phases due to single events are obtained from Table 01 If we denote 6 = {61,63, 64), the return 
map 

6' = F{6) (81) 

from the three-dimensional plane defined by (/)2 = to itself is obtained after all oscillators have 
fired exactly once (last row of Table . 

Table 01 displays the time evolution of a general perturbation event by event. As for the unper- 
turbed orbit described above, the left column gives the sequence of events and the second left column 
gives the time of these events. The right four columns give the phases of oscillators i £ {1, ... ,4} 
right after an event has occurred. The first row gives the initial condition at t = 0, just after the 
signal has been sent, S2, by oscillator i = 2. Before, at time t = —61 < 0, the signal of oscillator 
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t 


Mt) 






Mt) 




(1 


= '■ yl,o 


62 = 

= • r2,{) 


a + 
= ■ y:i.i) 


a + (5,1 
= '■ r Lo 




T — (5l 


r 

=: '/'I,! 


Hi{ip2,0 + T -61) 
= '■ 952,1 


Hi{(p3fi + T - Si) 
=: <^3,i 0.9843 < 1 


Hei^pAfi + T - 5i) 
=: ^4,1 ~ 0.9843 < 1 




T 


ifc(r + (5i) 
=: 1^1,2 


9^2,1 + Si 
= ■ ^2,2 


t^(¥'3,l + ^i) + £ > 1 
1 ^ 
=: ¥'3,2 


U{<p4,i+Si)+i> 1 
1 -» 
=: ¥'4,2 


i?3, i?4 


2t 


= ■ 951,3 


H2i{iP2,2 +t) 
= '■ <P2,3 


Hi{r) 

= ■ ¥'3,3 


Hs{r) 

=■ ¥'4,3 


Si 


2t - 1 - (/9l,3 


1 ^ 
=: ¥'1,4 


9^2,3 + 1 - ¥'1,3 

=: ¥'2,4 


¥"3,3 + 1 - ¥"1,3 

=: ¥^3,4 


¥"4,3 + 1 - ¥'1,3 

=: ¥'4,4 








1^0 


¥'3,3 + 1 — ¥^2,3 


¥'4,3 + 1 — ¥'2,3 


S2 


2t + 1 - ip2,3 


=: ^^1,5 
=:5i 


=: ¥'2,5 


=: ¥53,5 

=: a + ^3 


=: ¥'4,5 



i = 1 has been sent, denoted {Si); this signal will travel until time t = t — 6i. The initial phases 
(|<S()|) are displayed in the first column. Here (52 = by definition. Throughout the table, the phases 
after each event are labelled ipi^k where the first index labels the oscillator i and the second index 
counts the events k starting with k = for the initial condition as was also used in Table |2l above. 

For instance, the first event (after the initial condition). A; = 1, at time t = t — Si is the reception 
Ri of the signal sent by oscillator i = 1. Since there are no self- inter actions, the phase of oscillator 
z = 1 is only shifted in time, 

^1,1 =6i + {t-6i) = t. (82) 

The phases of all other oscillators i € {2, 3, 4} additionally jump because of the incoming sub- 
threshold signal, 

iPi,i = Hi{ipi^o + {T-6i)). (83) 

Again, as for the unperturbed dynamics, going through the table row by row, the phases are 
calculated event by event. The phases (fi^k for i € {1, . . . , 4} right after the events are approximated 
by the unperturbed phases pi^k defined in Table [21 

^i,k = Pi,k + 0{d) (84) 

for all k for which the pi^k are defined, k £ {0,2,3,5}. Here 0{S) denotes a function of all 6i, 
i € {1,3,4}, that approaches zero at least linearly if ah 6i 0, i.e. 0{S) := 0{6i). 
We thus obtain the return map 

F{S) = d' (85) 
= ('^'1,53,54) (86) 
= (</'l,5,'/'3,5 - 0,9^4,5 - a) (87) 

from the last row of Table Here the (/7j_5 again depend on the original perturbation vector S. 
From this identification we obtain the components 

Fi{6) = H2i{Hi{T + Si) + T)-H2e{Hi{T-5i) + r + 6i) 

F3{S) = Fi{d) = H2e{He{r) + T) - H^iiHgir - 5i) + r + 5i) 

Note that the component functions Fi{5) in ()88() are of order Fi{5) = 0{6)] moreover the dynamics 
clearly depends only on the initial perturbation 5i to this orbit. It is important to note that 
although (53 7^ and (54 7^ in general, this group is resynchronized at the next return, 5''^ = 5'^. 
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